Performance of a fully-automated system on a WHO malaria microscopy evaluation slide set.

BACKGROUND: Manual microscopy remains a widely-used tool for malaria diagnosis and clinical studies, but it has inconsistent quality in the field due to variability in training and field practices. Automated diagnostic systems based on machine learning hold promise to improve quality and reproducibility of field microscopy. The World Health Organization (WHO) has designed a 55-slide set (WHO 55) for their External Competence Assessment of Malaria Microscopists (ECAMM) programme, which can also serve as a valuable benchmark for automated systems. The performance of a fully-automated malaria diagnostic system, EasyScan GO, on a WHO 55 slide set was evaluated. METHODS: The WHO 55 slide set is designed to evaluate microscopist competence in three areas of malaria diagnosis using Giemsa-stained blood films, focused on crucial field needs: malaria parasite detection, malaria parasite species identification (ID), and malaria parasite quantitation. The EasyScan GO is a fully-automated system that combines scanning of Giemsa-stained blood films with assessment algorithms to deliver malaria diagnoses. This system was tested on a WHO 55 slide set. RESULTS: The EasyScan GO achieved 94.3 % detection accuracy, 82.9 % species ID accuracy, and 50 % quantitation accuracy, corresponding to WHO microscopy competence Levels 1, 2, and 1, respectively. This is, to our knowledge, the best performance of a fully-automated system on a WHO 55 set. CONCLUSIONS: EasyScan GO's expert ratings in detection and quantitation on the WHO 55 slide set point towards its potential value in drug efficacy use-cases, as well as in some case management situations with less stringent species ID needs. Improved runtime may enable use in general case management settings.

Towards harmonization of microscopy methods for malaria clinical research studies.

Microscopy performed on stained films of peripheral blood for detection, identification and quantification of malaria parasites is an essential reference standard for clinical trials of drugs, vaccines and diagnostic tests for malaria. The value of data from such research is greatly enhanced if this reference standard is consistent across time and geography. Adherence to common standards and practices is a prerequisite to achieve this. The rationale for proposed research standards and procedures for the preparation, staining and microscopic examination of blood films for malaria parasites is presented here with the aim of improving the consistency and reliability of malaria microscopy performed in such studies. These standards constitute the core of a quality management system for clinical research studies employing microscopy as a reference standard. They can be used as the basis for the design of training and proficiency testing programmes as well as for procedures and quality assurance of malaria microscopy in clinical research.

Insecticide-treated nets and malaria prevalence, Papua New Guinea, 2008-2014.

OBJECTIVE: To investigate changes in malaria prevalence in Papua New Guinea after the distribution of long-lasting Insecticide-treated nets, starting in 2004, and the introduction of artemisinin-based combination therapy in 2011. METHODS: Two malaria surveys were conducted in 2010-2011 and 2013-2014. They included 77 and 92 randomly selected villages, respectively. In each village, all members of 30 randomly selected households gave blood samples and were assessed for malaria infection by light microscopy. In addition, data were obtained from a malaria survey performed in 2008-2009. RESULTS: The prevalence of malaria below 1600 m in altitude decreased from 11.1% (95% confidence interval, CI: 8.5-14.3) in 2008-2009 to 5.1% (95% CI 3.6-7.4) in 2010-2011 and 0.9% (95% CI 0.6-1.5) in 2013-2014. Prevalence decreased with altitude. Plasmodium falciparum was more common than P. vivax overall, but not everywhere, and initially the prevalence of P. vivax infection decreased more slowly than P. falciparum infection. Malaria infections were clustered in households. In contrast to findings in 2008-2009, no significant association between net use and prevalence was found in the later two surveys. The prevalence of both fever and splenomegaly also decreased but their association with malaria infection became stronger. CONCLUSION: Large-scale insecticide-treated net distribution was associated with an unprecedented decline in malaria prevalence throughout Papua New Guinea, including epidemic-prone highland areas. The decline was accompanied by broader health benefits, such as decreased morbidity. Better clinical management of nonmalarial fever and research into residual malaria transmission are required.

Misclassification of Plasmodium infections by conventional microscopy and the impact of remedial training on the proficiency of laboratory technicians in species identification.

BACKGROUND: Malaria diagnosis is largely dependent on the demonstration of parasites in stained blood films by conventional microscopy. Accurate identification of the infecting Plasmodium species relies on detailed examination of parasite morphological characteristics, such as size, shape, pigment granules, besides the size and shape of the parasitized red blood cells and presence of cell inclusions. This work explores misclassifications of four Plasmodium species by conventional microscopy relative to the proficiency of microscopists and morphological characteristics of the parasites on Giemsa-stained blood films. CASE DESCRIPTION: Ten-day malaria microscopy remedial courses on parasite detection, species identification and parasite counting were conducted for public health and research laboratory personnel. Proficiency in species identification was assessed at the start (pre) and the end (post) of each course using known blood films of Plasmodium falciparum, Plasmodium malariae, Plasmodium ovale and Plasmodium vivax infections with densities ranging from 1,000 to 30,000 parasites/µL. Outcomes were categorized as false negative, positive without speciation, P. falciparum, P. malariae, P. ovale, P. vivax and mixed infections. DISCUSSION AND EVALUATION: Reported findings are based on 1,878 P. falciparum, 483 P. malariae, 581 P. ovale and 438 P. vivax cumulative results collated from 2008 to 2010 remedial courses. Pre-training false negative and positive misclassifications without speciation were significantly lower on P. falciparum infections compared to non-falciparum infections (p < 0.0001). Post-training misclassifications decreased significantly compared to pre- training misclassifications which in turn led to significant improvements in the identification of the four species. However, P. falciparum infections were highly misclassified as mixed infections, P. ovale misclassified as P. vivax and P. vivax similarly misclassified as P. ovale (p < 0.05). CONCLUSION: These findings suggest that the misclassification of malaria species could be a common occurrence especially where non-falciparum infections are involved due to lack of requisite skills in microscopic diagnosis and variations in morphological characteristics within and between Plasmodium species. Remedial training might improve reliability of conventional light microscopy with respect to differentiation of Plasmodium infections.

Developing standards for malaria microscopy: external competency assessment for malaria microscopists in the Asia-Pacific.

BACKGROUND: Malaria diagnosis has received renewed interest in recent years, associated with the increasing accessibility of accurate diagnosis through the introduction of rapid diagnostic tests and new World Health Organization guidelines recommending parasite-based diagnosis prior to anti-malarial therapy. However, light microscopy, established over 100 years ago and frequently considered the reference standard for clinical diagnosis, has been neglected in control programmes and in the malaria literature and evidence suggests field standards are commonly poor. Microscopy remains the most accessible method for parasite quantitation, for drug efficacy monitoring, and as a reference of assessing other diagnostic tools. This mismatch between quality and need highlights the importance of the establishment of reliable standards and procedures for assessing and assuring quality. This paper describes the development, function and impact of a multi-country microscopy external quality assurance network set up for this purpose in Asia. METHODS: Surveys were used for key informants and past participants for feedback on the quality assurance programme. Competency scores for each country from 14 participating countries were compiled for analyses using paired sample t-tests. In-depth interviews were conducted with key informants including the programme facilitators and national level microscopists. RESULTS: External assessments and limited retraining through a formalized programme based on a reference slide bank has demonstrated an increase in standards of competence of senior microscopists over a relatively short period of time, at a potentially sustainable cost. The network involved in the programme now exceeds 14 countries in the Asia-Pacific, and the methods are extended to other regions. CONCLUSIONS: While the impact on national programmes varies, it has translated in some instances into a strengthening of national microscopy standards and offers a possibility both for supporting revival of national microcopy programmes, and for the development of globally recognized standards of competency needed both for patient management and field research.

A large proportion of asymptomatic Plasmodium infections with low and sub-microscopic parasite densities in the low transmission setting of Temotu Province, Solomon Islands: challenges for malaria diagnostics in an elimination setting.

BACKGROUND: Many countries are scaling up malaria interventions towards elimination. This transition changes demands on malaria diagnostics from diagnosing ill patients to detecting parasites in all carriers including asymptomatic infections and infections with low parasite densities. Detection methods suitable to local malaria epidemiology must be selected prior to transitioning a malaria control programme to elimination. A baseline malaria survey conducted in Temotu Province, Solomon Islands in late 2008, as the first step in a provincial malaria elimination programme, provided malaria epidemiology data and an opportunity to assess how well different diagnostic methods performed in this setting. METHODS: During the survey, 9,491 blood samples were collected and examined by microscopy for Plasmodium species and density, with a subset also examined by polymerase chain reaction (PCR) and rapid diagnostic tests (RDTs). The performances of these diagnostic methods were compared. RESULTS: A total of 256 samples were positive by microscopy, giving a point prevalence of 2.7%. The species distribution was 17.5% Plasmodium falciparum and 82.4% Plasmodium vivax. In this low transmission setting, only 17.8% of the P. falciparum and 2.9% of P. vivax infected subjects were febrile (≥ 38°C) at the time of the survey. A significant proportion of infections detected by microscopy, 40% and 65.6% for P. falciparum and P. vivax respectively, had parasite density below 100/µL. There was an age correlation for the proportion of parasite density below 100/µL for P. vivax infections, but not for P. falciparum infections. PCR detected substantially more infections than microscopy (point prevalence of 8.71%), indicating a large number of subjects had sub-microscopic parasitemia. The concordance between PCR and microscopy in detecting single species was greater for P. vivax (135/162) compared to P. falciparum (36/118). The malaria RDT detected the 12 microscopy and PCR positive P. falciparum, but failed to detect 12/13 microscopy and PCR positive P. vivax infections. CONCLUSION: Asymptomatic malaria infections and infections with low and sub-microscopic parasite densities are highly prevalent in Temotu province where malaria transmission is low. This presents a challenge for elimination since the large proportion of the parasite reservoir will not be detected by standard active and passive case detection. Therefore effective mass screening and treatment campaigns will most likely need more sensitive assays such as a field deployable molecular based assay.